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(54) Device and method. for image pickup 

(57) An image plci(up device includes a CCD which 
picks up an image of. a subject, and a front end proces- 
sor which corrects data for the picked-up Image by a 



light quantity distribution con-ection table for con-ectlng 
the data for the picked-up image based on a light quan- 
tity distribution when the image is photographed using 
a flash. 
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Is photographed using a flash (step S402). A signal (im- 
age pickup data) output from the CCD 102 Is subjected 
to CDS processing (sampled and held) by the CDS 110 
(step S403). 

[0024] The CPU 109 reads correction data from the 5 
correction table stored In the EEPROM 1 07 and sets the 
correction data in the AGC 111 (step S407). The AGC 
1 1 1 conducts automatic gain control to the image pickup 
data while changing gains based on the set correction 
data (step S404). The image pickup data subjected to io 
automatic gain control is converted to digital data by the 
ADC 1 1 2 (step S405) and then subjected to camera sig- 
nal processing (step S406). 

[0025] The correction coefficient table used to correct 
the image pickup data by the DSP/JPEG processor 1 04 is 
will be explained below. Fig. 5 Is a block diagram show- 
ing the configuration of the DSP/JPEG processor 104 
which performs camera signal processing. Four pieces 
of raw data (R, Gr, Gb, and B) from the CCD are input 
into the DSP/JPEG processor 104 where these four 20 
pieces of data are branched into four color signals by a 
multiplexer 502 and fed to variable gain amplifiers 503a 
to 603d, respectively. The amplifiers 503a to 503d are 
used to perfomi correction and setting of white balance 
(WB) of the present invention. 25 
[0026] The gains of the variable gain amplifiers 503a 
to 503d are controlled by the CPU. When an operation 
according to the first embodiment is to be performed, 
gain tables by as much as the number of all the pixels 
of the CCD are used. The tables are stored In the.EEP- so 
ROM 107 shown in Fig. 1. The DSP/JPEG processor 
1 04 also includes an evaluation value generation block. 
The evaluation value generation block operates four in- 
tegrated values of, for example, SR, ZGr, IGb, and IB 
to thereby generate an evaluation value. The CPU 1 09 35 
determines the state of the image from the evaluation 
value thus generated and performs setting of WB and 
corrections to the respective signals. The signals pass- 
ing through the variable gain amplifiers 503a to 503d, 
respectively, are transfonmed to RGB signals by a 4 x 40 
3 matrix 504 provided In the next stage and fed to a lu- 
minance signal/color signal processor. 
[0027] Fig. 6 is a flow chart of processing perfomned 
by the DSP/JPEG processor 104 when the processor 
1 04 corrects image pickup data. The digital camera first 
acquires infomnation on the distance of the digital cam- 
era to a subject using the number of pulses which are 
generated during an AF operation (step S601 ). The sub- 
ject is photographed using a flash (step S602). A signal 
(image pickup data) output from the CCD 102 is sub- so 
jected to CDS processing (sampled and held) by the 
CDS 110 (step S603). 

[0028] The image pickup data thus CDS processed is 
output to the AGC 111 and the gain of the image pickup 
data is controlled by the AGC 1 1 1 (step S604). The ADC S5 
112 converts the data to digital data (step S605) and 
further subjects the digital data to camera signal 
processing (step 606). At this moment, the CPU 109 
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reads the correction coefficient table from the EEPROM 
107 and sets correction coefficients as the coefficients 
of the variable gain amplifiers that are set according to 
the pixels of the CCD (step S607). 
[0029] According to the image pickup device of the 
first embodiment explained so far, it is possible to pro- 
vide an Image pickup device which can prevent the deg- 
radation of Image quality due to an uneven luminous in- 
tensity distribution and which can fomri a high-quality Im- 
age even If a subject is photographed using the flash 
from a relatively short distance. In addition, according 
to the image pickup device of the first embodiment, there 
Is no need to locate the flash at a position near the op- 
tical system In the digital camera, thereby making it posr 
sible to Improve the degree of freedom to design the lay- 
out of the digital camera. 

[0030] According to the first embodiment, the hard- 
ware configurations of the circuits and the flash are not 
changed. Therefore, it is possible to prevent the circuits 
mounted on the digital camera from being complicated 
in configuration, made large in size and to prevent cost 
from increasing. Thus, it is possible to conrect the une- 
ven luminous intensity distribution without preventing 
the digital camera from, being made smaller in size and 
lighter in weight and preventing the cost thereof from 
increasing. 

[0031 ] The present invention Is not limited to the con- 
figuration which has been explained so far but may have 
the following configuration. For example, the digital Im- 
age pickup device nonnally performs shading correction 
to con-ect the uneven luminous intensity distribution of 
an Image pbkup region whk:h occurs because of the 
shading. Figs. 7A and 7B explain an uneven luminous 
Intensity distribution caused by shading. When the im- 
age of a line L shown in Fig. 7A Is picked up, the uneven 
luminous intensity distribution caused by shading is rep- 
resented as a decrease in the light quantity of the end 
portions of the line L as shown in Fig. 7B. 
[0032] According to the Image pickup device ex- 
plained in the first embodiment, a connection character- 
istic for subjecting image pickup data to shading correc- 
tion can be also added to the correction table. The cor- 
rection characteristic is an opposite characteristic to the 
light quantity distribution shown, for example, in Fig. 78. 
The correction table or correction coefficient table of the 
gain amplifier is set in the EEPROf^ 107. More specifi- 
cally, the correction table shows the opposite character- 
istic to the characteristic obtained by adding the light 
quantity distribution shown in Fig. 78 to the light quantity 
distribution shown in Fig. 28. By thus setting, the image 
pickup device can simultaneously execute the correc- 
tion during slroboscopic photographing and shading 
correction. 

[0033] The luminous intensity distribution during stro- 
boscopic photographing is often Influenced by external 
light. In this case, a trouble may occur when image pick- 
up data is corrected using the correction data as ex- 
plained in the first embodiment. To prevent this possible 
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disadvantage, as shown In Fig. 8, the Image pickup de- 
vice according to the present Invention may include a 
switch 801 In addition to the constituent elements shown 
. In Fig. 1. This switch 801 is used to select whether or 
not the Image pickup data Is to be corrected. Therefore, 
an operator can select execution or non-execution of the 
correction using the switch. Alternatively, according to 
the present Invention, the CPU 109 automatically de- 
tects an uneven luminous intensity distribution from the 
image pickup data picked up by the CCD 102 and de- 
termines vyhether or not correction is to be executed, 
[0034] According to the image pickup device of the 
first embodiment, the correction of Image pickup data 
on a binary image such as a character Image can be 
executed by lowering correction accuracy. The correc- 
tion accuracy can be lowered by, tor example, setting 
the resolution of the correction table to be coarse. Alter- 
natively, the correction accuracy can be lowered by low- 
ering the resolution (the number of bits) of each correc- 
tion data k(m, n). 

[0035] A threshold table Is generally required tor 
processing of Image pickup data for a binary image. In 
the first embodiment, the image pickup data for the bi- 
nary image is processed using the threshold table In 
which thresholds multiplied by the respective correction 
data set In the correction table shown in Fig. 3 are set, 
and It Is thereby possible to correct the uneven luminous 
intensity distribution caused by the flash simultaneously 
with the binarizatloh of the Image pickup data. 
[0036] A second embodiment of this invention will be 
explained below. An Image pickup device of the second 
embodiment has the same configuration as that of the 
first embodiment, and therefore the constituent ele- 
ments of the Image pickup device are not explained or 
shown In the drawings partially. 
[0037] In the Image pickup device of the second em- 
bodiment, the EEPROM 107 holds a plurality of correc- 
tion tables explained In the first embodiment. In addition, 
the CPU 109 corrects Image pickup data using the cor- 
rection table which corresponds to a distance between 
the device and a subject measured from the number of 
pulses which are generated when the auto-focusing 
section 101 Is driven or the distance measured by an 
external AF sensor 901 . 

[0038] That is. the image pickup device of the second 
embodiment stores In the EEPROM 107 a plurality of 
correction tables which correspond to the distances be- 
tween, the digital camera and a subject, respectively. 
The CPU 1 09 measures the distance of the digital cam- 
era to the subject, selects and reads the correction table 
which corresponds to the obtained distance, and sets 
the read correction table in the AGC 111 or the DSP/ 
JPEG process or 1 04, An uneven luminous intensity dis- 
tribution during stroboscopic photographing changes 
according to the distance to the subject. Therefore, ac- 
cording to the image pickup device of the second em- 
bodiment, it is possible to correct the Image pickup data 
using correction data which corresponds to an uneven 



luminous intensity distribution closer to an actual une- 
ven luminous intensity distribution and to correct the Im- 
age pickup data more appropriately. 
[0039] If there is no correction table which corre- 

5 spends to the distance obtained by measurement in the 
EEPROIVl 107, the image pickup device of the second 
embodiment corrects the image pickup data by linear 
Interpolation using the correction table stored in the 
EEPROM 107. According to the image pickup device of 

10 the second embodiment, the image pickup data can be 
corrected more appropriately while the number of cor- 
rection tables to be stored Is suppressed. 
[0040] The image pickup device of the second em- 
bodiment Is not limited to the configuration In which the 

'5 distance of the device to the subject is measured from 
the number of pulses which are generated when the au- 
to-focuslng section 101 Is driven. The image pickup de- 
vice may also Include an external AF sensor 901 as 
shown in Fig. 9. If including the external AF sensor 901 , 

20 the image pickup device of the second embodiment se- 
lects the correction table which corresponds to the dis- 
tance measured by the AF sensor 901 and uses the ta- 
ble for correcting the Image pickup data. 
[0041 ] A third embodiment of this invention will be ex- 

25 plained below, and an image pickup device of the third 
embodiment will be explained. The image pickup device 
of this embodiment has the same configuration as the 
image pickup device shown In Fig. 1 or Fig. 9. Therefore, 
the constituent elements of the Image ptekup device of 

30 this embodiment will not be explained or shown In the 
drawings partially. The third embodiment Is provided to 
solve the problem as follows. That Is, when a binary im- 
age is to be picked up. binarizatlon accuracy is higher 
as signal level is higher. If the light emission quantity of 

35 the flash Is increased excessively so as to Increase the 
signal level, a white void or white voids may occur In a 
picked-up image. 

[0042] In the third embodiment, when the digital cam- 
era picks up a binary image, the CCD 102 controls the 

40 flash 108 so as to emit light at least twice in different 
light quantities to pickup an image of a subject. The CPU 
109 then corrects image pickup data using the data for 
the images picked-up In different light quantities. 
[0043] In the third embodiment, the CPU 1 09 controls 

45 the CCD 1 02 and the flash 1 08 to photograph the sub- 
ject twice. This photographing is perfomned by changing 
the quantity of light enriitted from the flash. The larger 
quantity of light emission is set as light emission quantity 
1 and the smaller quantity of light emission is set as light 

50 emission quantity 2. The light emission quantity 1 is set 
to a quantity in which a sufficient signal level for neces- 
sary binarization accuracy is obtained. The light emis- 
sion quantity 2 is set to a quantity in which no white void 
occurs. 

55 [0044] In the third embodiment, the CPU 1 09 controls 
the CCD 102 to photograph a binary image of the sub- 
ject in the light emission quantity 1 for the first time. Im- 
age pickup data (image pickup data 1) obtained by the 



